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Abstr act. We present a method for the explicit diagonalization of some Han- 
kel operators. This method allows us to recover classical results on the diag- 
onalization of Hankel operators with the absolutely continuous spectrum. It 
leads also to new results. Our approach relies on the commutation of a Hankel 
operator with some differential operator of second order. 



1. Introduction 

1.1. Hankel operators can be defined (see, e.g., book jSJ) as integral operators 
in the space L 2 (R+) whose kernels depend on the sum of variables only. Thus, a 
Hankel operator A is defined by the formula 



(Af)(x) = / a(x + y)f(y)dy. (1.1) 
Jo 

Of course, A is self-adjoint if a — a. If 

\a(x)\ 2 xdx < oo, 



o 



then A belongs to the Hilbert-Schmidt class. This condition is satisfied if, for 
example, the function a is continuous, it is not too singular at x = and decays 
sufficiently rapidly as x — > oo. On the contrary, if a(x) ~ a$x~ l as x — ¥ or (and) 
a(x) ~ aooX -1 as x — > oo, then the operator A is no longer compact although it 
remains bounded. A general philosophy (see paper [4] by J. S. Howland) is that 
each of these singularities gives rise to the branch [0,ao7r] or (and) [0, a^Tr] of the 
simple absolutely continuous spectrum. 

There are very few examples where the operator A can be explicitly diagonalized, 
that is its exact eigenf unctions can be found. The first result is due to F. Mchlcr 
[6] who considered the case a(x) = (x + 2) _1 . He has shown that functions 

l li 

4>k(x) = (/ctanh7rfc) P-\/2+ik{ x + 1), A = 7r/ cosh7rfc, k > 0, (1.2) 

where P-i/2+ik lS the Legendre function (see [3], Chapter 3), satisfy equations 
Aipk — \iph- The functions ipk are usually parametrized by the quasimomentum k 
related to A = A(fc) by formula (fT2]l . The operator U : i 2 (K+) -> L 2 (R + ) definecfl 
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precise definition of the operator U can be given in terms of the corresponding sesquilinear 

form. 
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by the equality 



(Uf)(k) = / Mx)f(x)d: 



(1.3) 



Jo 



is unitary. Observe that A(fc) is a one-to-one mapping of M+ on (0, ir) and that 
(ULf)(k) = X(k)f(k) which implies that the spectrum of the operator A is simple, 
absolutely continuous and coincides with the interval [0,7r]. 

Below we use the term "eigenfunction" for ipk (although tpk $ L 2 (R + )) such 
that Aipk = AV'fc for the spectral parameter A from the continuous spectrum of 
the operator A. By definition, we also say that eigenfunctions of the continu- 
ous spectrum are orthogonal, normalized and the set of all ipk is complete if the 
corresponding operator (|1.3|) is unitary (if A has no point spectrum) . 

The next result is due to W. Magnus j5i who considered the case a(x) = 
x~ 1 e~ x / 2 . A more general result of the same type was obtained by M. Rosenblum 
[9] who has diagonalized the operator A with kernel 



kernel is again simple and, up to a finite number of eigenvalues, it is absolutely 
continuous and coincides with the interval [0,7r]. Its "normalized eigenfunctions" 
are expressed in terms of the Whittaker functions 

ip k {x) = (2ir)- 1 v / k\r{l/2- ik + f3)\smh2nkx~ 1 W„ l3ilk (x), k > 0. (1.5) 

Observe that the function a(x) = (x + 2) _1 is singular at x — oo and eigenfunc- 
tions ljl.2)l decay as linear combinations of x~ x / 2±lk as x — > oo while function (|1.4j) 
is singular at x = and eigenfunctions (|1.5j) behave as linear combinations of the 
same functions x~ 1 ^ 2±lk as x — > 0. 

We note also a simple case a(x) — x^ 1 where the operator A is directly diago- 
nalized (see paper [2] by T. Carleman) by the Mellin transform. In this case the 
spectrum of A has multiplicity 2 (because of the singularities of a(x) both at x — 
and at x = oo), it is absolutely continuous and coincides with the interval [0, n]. The 
eigenfunctions of the Carleman operator equal x _1 / 2 ± lfc ( U p to a normalization). 

We emphasize a parallelism of theories of singular differential operators and 
Hankel operators with singular kernels. Thus, the functions x~ x l 2±%k play (both 
for x — > oo and x — > 0) for Hankel operators the role of exponential functions e ±lkx 
for differential operators of second order. From this point of view, the Carleman 
operator plays the role of the operator —d 2 jdx 2 in the space L 2 (R). 

1.2. In the author's opinion, the reason why in the cases described above eigen- 
functions of a Hankel operator can be found explicitly remained unclarified. Our 
approach shows that all diagonalizable Hankel operators A commute with differen- 
tial operators 



for suitably chosen parameters a > 0,/5 £ 1 and 7 > 0. Thus, eigenfunctions of 
the operators A and L are the same which allows us to diagonalize the operator A. 

Hopefully the commutator method will be applied to other kernels a. In this 
paper we use the commutator method to find in subs. 4.4 eigenfunctions of a new 




L = —-7-{x 2 + jx)— — I- ax 2 + fix 



dx dx 



(1.6) 
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Hankel operator with kernel 

a(x) = \l-KUV8x), (1.7) 
V x 

where K\ is the MacDonald function (see [3], Chapter 7). Similarly to (|1.4|) . this 
function decays exponentially as x — > oo and a(x) ~ x" 1 as x — > 0. An example 
of a different nature are Hankel operators with regular kernels; such operators are 
compact. 

Note that operator |L6j) for 7 = and a > appeared already in [9.. Actually, 
M. Rosenblum proceeded from the identity 

POD 

r(i + P)J (x + v^W-pvte + y)y- 1 w. P My)dy = —^ x ~ 1w -p^{x) 

(1.8) 

found earlier by H. Shanker in [10] . This identity shows that functions (|1.5[) arc 
eigenfunctions of the Hankel operator with kernel (| 1 .4[) . M. Rosenblum observed 
that functions (|1.5I) are also eigenfunctions of operator (|1.6p for 7 = and a = 1/4. 
Since eigenfunctions of the self-adjoint differential operator L are orthogonal and 
complete, the same is true for eigenfunctions of the Hankel operator A with kernel 
(jl.4[) . This yields the diagonalization of this operator. 

Our approach is somewhat different. We prove the relation LA = AL which 
shows that eigenfunctions of the operators L and A are the same. In particular, we 
obtain identity (ll.8[) without a recourse to the theory of special functions. 

It is well-known that the integrability of differential equations of second order 
in terms of special functions has a deep group-theoretical interpretation (see, e.g., 
book [12] by N. Ya. Vilenkin). As far as Hankel operators are concerned, it is 
evident that the diagonalization of the Carleman operator can be explained by its 
invariance with respect to the group of dilations. The relation LA — AL means 
that the operator A is invariant with respect to the group exp(— itL). In contrast 
to the Carleman operator, for other Hankel operators this invariance does not look 
obvious. 

A commutator scheme is presented in Section 2 while specific examples of kernels 
singular at x = 00 and x = are discussed in Sections 3 and 4, respectively. Hankel 
operators with regular kernels are considered in Section 5. 

2. Commutator method 

2.1. For a moment, we consider the operator L defined by formula (|1.6[) as a 
differential operator on the class C 2 (R+), but later it will be defined as a self-adjoint 
operator in the space L 2 (R + ). Let the operator A be given by formula (jl.ip where 
aeC 2 (M+). 

Let us commute the operators A and L. Suppose that / 6 C 2 (K + ) and that 

\im(y 2 + 7 y)f(y) = \im(y 2 + iy )f(y) = (2.1) 

y->0 y^Q 

as well as 

lim a'(x + y){y 2 + jy)f(y) = lim a(x + y){y 2 + jy)f(y) = (2.2) 

y— ^00 y— >oo 

for all x > 0. Then integrating by parts, we find that 

f°° / d \ 
{ALf)(x)= J i y ~—((y 2 + 1 y)a'(x + y))+a(x + y)(ay 2 +(3y))f(y)dy. 



4 



D. R. YAFAEV 



It follows that 

poo 

((LA-AL)f)(x) = / q(x,y)f(y)dy 
Jo 

where 

Q 
q(x, V) = " {{x 2 + jx)a'(x + y)) + — ((y 2 + jy)a'(x + y)) 

+ (ax 2 — ay 2 + (3x — (3y)a(x + y) 

=(x -y)(-(z + i)a"{z) - 2a' (z) + (az + /3)a(z)J 

and z — x + y. Thus, we arrive at the following general result. 

Theorem 2.1. Suppose that kernel a of a Hankel operator A satisfies the differen- 
tial equation 

-(x + j)a"(x) - 2a (x) + (ax + [3)a(x) = 0. (2.3) 
Let f € C 2 (R+) and let conditions (|2~Tj) and (HT2|) hold. Then 

(LA — AL)f = 0. (2.4) 
Note that after a change of variables 

a(x) = (.T + 7 )- 1 fo(x + 7) (2.5) 
in (|2.3p . we get the Schrodinger equation with the Coulomb potential 

-b"(r) + (a + f3r- 1 )b(r) = 0. (2.6) 

2.2. In specific examples below, we are going to use Theorem l2.1l in the following 
way. If L is self-adjoint and has a simple spectrum, then the equality LA = AL 
shows that A is a function F of L, i.e., the operators A and L have common 
eigenfunctions. For a calculation of the function F, we argue as follows. Suppose 
that a function tp^ satisfies conditions (|2.1I) . (12.21) and the equation 

- ((x 2 + ix)^(x))' + (ax 2 + Px)%{x) = nMx). (2.7) 

Then according to equality (|2.4[) the same equation holds for the function Ai/j^ and 
hence, for some numbers A = A^ and A = A^, 

(Aip„)(x) = Xil> M (x) + AVv(:r) (2.8) 

where is a solution of the equation Lip^ = fiijj^ linearly independent of tp^. 
Further, comparing asymptotics of the functions ip^x), ^^(x) and (Atp^)(x) as 
x — y and x — > oo, we see that A = and find A = F(/i) as a function of /i. 
Finally, if tp^ belong to the domain of some self-adjoint realization of the differential 
operator L, then, for a proper normalization of functions ip^, the system of all ip^ 
is orthogonal and complete. In this case A — F(L). Note that this approach allows 
one to avoid precise definitions of commutators and references to the functional 
analysis. 

It turns out that in all our applications F(/i) = 7r/cosh (tt\/ fJ- — 1/4) , and hence 

A = tt/ cosh (tt^L - 1/4) . 

Actually, it is somewhat more convenient to parametrize eigenfunctions by the 
quasimomentum k > related to fi and A by the formulas 

/i = k 2 -\- 1/4 £ (1/4, oo), A = 7r/cosh7rfc e (0,tt). (2.9) 
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Note that ipk(x), ^^{x) and ip\{x) denote the same function provided the parame- 
ters k, fi and A are related by formulas ()2.9j) . 

The operator U defined by formula (| X .3[) is unitary and the operator UAU* acts 
in L 2 (R + ) as multiplication by the function X(k) = ir/ cosh7rfc. Indeed, according to 
the Fubini theorem it follows from the equation Ai/jk — X(k)i/jk that for g £ Cq°(R+) 



{AU*g)(x)= dkg(k) dya(x + y)Mv) 
Jo Jo 

\{k)i, k {x)g{k)dk = (U*(Xg))(x), 



o 

or equivalently 

(UAf)(k) = X(k)(Uf)(k), V/eL 2 (l + ). (2.10) 

Since A : R+ — > (0, 7r) is a smooth one-to-one mapping, the operator A has the 
simple absolutely continuous spectrum [0,7r]. 

To realize this scheme, it is convenient to study the cases of singularities at 
x = oo when 7 > and at x = when 7 = separately. 

3. Singularity at infinity 

3.1. Set 7 = 2. We first suppose that a = = 0. Then the function a(x) = 
(x + 2) _1 satisfies equation (|2.3I) . and the corresponding operator 

L = — -^p{x)— where p(x) = x 2 + 2.x. 
dx dx 

Let P v (z) and Q v (z) be the Legendre functions (see, e.g., [3], Ch. 3) of the first 
and second kinds, respectively. They are defined as solutions of the equation 

(1 - z 2 )u"(z) - 2zu'(z) + v{v + l)u(z) =0, z>l, 

satisfying the conditions P u (l) — 1 and Q v {z) = — 2 _1 ln(z — 1) + c v as z — > 1 + 
(the value of the number c v is inessential). Then the functions P_i/2+jfc(x + 1) and 
Q-i/2+ik{ x + 1) satisfy the equation Lu = (k 2 + 1/A)u. We also note that (see 
formulas (2.10.2) and (2.10.5) of 0) 

P-i/2+ lk (x + 1) = m(k)x- 1/2+lk +~Mk)x- 1 ' 2 - lk +0(x- 3 / 2 ), x^oo, (3.1) 

where 

m(k) = = r(?fc) T k . (3.2) 

V ' V2^r(l/2 + ifc) V ' 

The operator L is symmetric in the space L 2 (M + ) on the domain C^°(M + ), 
but it is not essentially self-adjoint. Since both functions P_x/2+%k{ x + 1) an d 
Q-i/2+ik(x+l) belong to L? in a neighborhood of the point x = 0, the defect indices 
of the operator L are (1,1). One of self- adjoint extensions of L from C^°(R+) (it 
will be also denoted by L) is defined on the domain T>(L) consisting of functions 
f(x) from the Sobolev class H 2 oc (M + ) satisfying the boundary conditions 

3 1im/(x), f'(x) = o(x-^ 2 ), x^ 0, (3.3) 

x— >0 

(we call these boundary conditions regular); it is also required that / € L 2 (R + ) and 
Lf e L 2 (K + ). Actually, the direct integration by parts shows that the operator L 
is symmetric. Furthermore, using the appropriate Green function, we find that for 
all h G i 2 (R + ) the equation (pf )' = h has a solution satisfying condition 
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Thus the image of the operator L coincides with L 2 (R+), and hence L is self-adjoint 
(cf. §132, part II, of pQ). 

3.2. For a study of the operator L, it is convenient to make a standard (see, 
e.g., book [TT] by E. C. Titchmarsh) change of variables. Set 

f = u(x) = f 1 'p(y)- 1/2 dy and f(x) = uj' {x) 1 ' 2 f(u(x)) =: (Ff)(x). (3.4) 
Jo 

The operator F is unitary in the space L 2 (R + ), and the operator L = F~ 1 LF acts 
by the formula L — —d 2 /dt 2 + q(rj(t)) where 

q{x) = -16-V(aj)~V(a:) 2 + AT x p"{x) 

and r\ = ui^ 1 is the inverse function to ui (so that x = 77(f)). 
In the case p(x) = x 2 + 2x we have 

u(x) = 2ln(x 1/2 + (x + 2) 1/2 ) - In 2 (3.5) 

and hence 

£= — + «(*) + 1/4, (3.6) 

where g(<) = -4- 1 (r ? 2 (i) + 2r t {t)y 1 . Since a; (a;) = (2a;) 1 / 2 + 0(x) as x -> and 
w(x) = ln(2a;)-|-0(a: _1 ) as x — > oo, we see that 77(f) ~ f 2 /2 as f — > and 77(f) ~ e*/2 
as f -> 00. It follows that q(t) ~ — (4f 2 ) -1 as f -> and g(f) = 0(e - *) as f -> 00. 
Note that the operator L is self-adjoint on the domain T>{L) consisting of functions 
/(f) from the Sobolev class H 2 oc (R + ) satisfying the boundary conditions 

aiimf- 1 / 2 /^), /'(f)-(2f)- 1 /(t) = o(f 1 / 2 ), f^O, (3.7) 

and such that / E L 2 (R+), Lf e L 2 (R + ). 

All usual results of spectral and scattering theories can be applied to the oper- 
ator L and then used for the operator L. The operator L has a simple absolutely 
continuous spectrum coinciding with the interval [1/4, 00). It does not have eigen- 
values because the equations Lu — (j,u, or equivalently Lu = fm, for /1 e 1 do 
not have solutions from L 2 (M. + ) satisfying the regular boundary conditions at zero. 
The diagonalization of the operator L can be constructed (see, e.g., [HI [13]) in the 
following way. Let Ufc(f), k > 0, be a real- valued solution of the equation 

Lu k = (k 2 + l/4)« fc (3.8) 

satisfying boundary conditions (13.71) . It has the asymptotics 

u k (t) = m{k)e lkt + Mk)e- lkt + o(l) (3.9) 

as f — > 00. Then the operator U defined by the equation 

/>oo 

(Uf)(k) = (2 7 r)- 1 / 2 |m(fc)|- 1 / u k (t)f(t)dt, (3.10) 

Jo 

is unitary in the space L 2 (R + ) and (ULf)(k) = (k 2 + 1/4) (£//)(&). 

Let us now make the change of variables (|3.4|) and set U — FUF^ 1 . Note that 

(27r)" 1/2 |m(fc)r 1 = V/ctanhTrfc 
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for the function m{k) denned by equation (|3.2|1 . It follows that the operator U 
defined by the equation 

1*00 

(Uf)(k) = VfctanliTrfc / P_ 1/2+ik (x + l)f(x)dx, (3.11) 
Jo 

is unitary in the space L 2 (R+) and 

(ULf)(k) = (k 2 + l/4)(Uf)(k). (3.12) 

3.3. Now we return to the Hankel operator A. Observe that the function 
P-i/2+ik( x + 1) satisfies^ both boundary conditions (|2.1j) and (I2.2[) . It follows from 
Theorem O that 

/ (x + y + 2)- 1 P_ 1/2+lk (y + l)dy = XP_ 1/2+ik (x + l) + XQ_ 1/2+ik {x + l). (3.13) 
Jo 

Considering here the limit x — > 0, we see that A = 0. Then we take the limit 
x — y 00 . It easily follows from (|3.ip that the left-hand side of (13. 13)) equals 

2 Re (m(k) J (x + y + 2)- 1 y- 1/2+ik dy) + O^ 1 ) 

= 2 Re (m(k)x~ 1/2+lk £ \t + lyH^+^dtj + 0{x~ l ), 

where we have set y = xt. Comparing this asymptotics with asymptotics (|3.1|1 of 
the right-hand side of (|3.13j) . we see that 

/>00 

A = / {t + iyh-^^dt = Tr(coshTrfc)- 1 (3.14) 
Jo 

and hence 

/>oo 

/ (x + y + 2)- 1 P_ 1/2+lk {y+l)dy = ir(coshirk)- 1 P_ 1/2+tk {x + l). (3.15) 
Jo 

It yields equation (|2.10|) with the operator U dehned by formula (|3.11j) . Since the 
operator U is unitary, we have recovered the result of F. Mehler [B]. 

Proposition 3.1. The Hankel operator with kernel a(x) = (iz; + 2)~ 1 has the simple 
absolutely continuous spectrum coinciding with the interval [0,7r]. Its normalized 
eigenfunction corresponding to the spectral parameter X — ^(coshTrfc)^ 1 is given by 
formula (jl.2p . 

We emphasize that equation (13. 15)) has been obtained as a direct consequence of 
the commutator method, without any use of the theory of special functions. 

4. Singularity at zero 

In the first three subsections we study the Hankel operator with kernel (|1.4|) and 
in subs. 4 - with kernel (|1.7[) . In both cases a(x) ~ x' 1 as x — > and a(x) decays 
exponentially as x — > 00. The corresponding operator L is defined by formula (jl.6[) 
where 7 = 0. 

4.1. Note that in the case 7 = 0, after a change of variables 

tp(x) = X~ 1 Lf(x) 

2 We are obliged to choose regular boundary conditions at zero since the function Q_ 1/2+ifc i xJ r 
1) does not satisfy the second boundary condition l|2.1j l 
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in (|2.7|) . we get again (cf. equation (|2.6jl ) the Schrodinger equation 

- ip"(x) + {a + fix- 1 - nx~ 2 )(p{x) = (4.1) 

with the Coulomb potential but with a non-zero orbital term. Below we set a = 1 /4. 

Recall that the Whittaker function W~p :P (x) can be defined as the solution of 
equation (|4.ip for /i = 1/4 — p 2 such that 

W- P , v {x) = x- p e- x P(l + Oix- 1 )) (4.2) 

as x — > oo. Of course, W-p > - p (x) — W-p >p (x). In particular, the function b(x) — 
W- p ,1/2(2;) satisfies equation (|2.6|l (where a = 1/4). 

As far as asymptotics as x — > are concerned (see §6.8 of [3]), we note that 

W_ Wfc (x) = m(k)x 1/2+lk + ~MU)x 1 l 2 - ik + 0(x 3/2 ), k > 0, a; -> 0, (4.3) 

where 

m(fc) =r(-2ifc)r^ 1 (l/2-ifc + /3). (4.4) 
If p > and -1/2+JJ + /? 7^ -1,-2, . . ., we have as x 

W^^x) ^r(2p)r(l/2+p + /3)- 1 a ; 1 /2-P j p >0 , 

W_0,o(x) - -r(l/2 + /3)a; 1/2 lnx. 

If — 1/2 + p + P = — n where n — 1,2,..., then taking into account formulas 
(6.9.4) and (6.9.36) of [3], we can express the Whittaker functions in terms of the 
Laguerre polynomials: 

W-foix) = (-l) n_1 (n - l)\e- x ' 2 x p+1 / 2 L 2 ^_ x {x). (4.6) 

If 7 = and a = 1/4, then 

L = -^x 2 ^+x 2 /A + fix. (4.7) 
ax ax 

We emphasize that the coefficient j3 may be arbitrary. It turns out that the strong 
degeneracy of the function x 2 at x = gives rise to a branch of the absolutely 
continuous spectrum of the operator L. 

First, let us define L as a self-adjoint operator in the space L 2 (M + ). We will 
check that the operator L is essentially self-adjoint on the domain C °°(R + ). Le10 
(Ff)(x) = x^^filnx). Then the transformation F : L 2 (R) -> L 2 (R + ) is unitary 
and the operator L = F~ 1 LF acts by formula (|3.6j) where q(t) — e 2t /4 + fie 1 . 
This is already a standard Sturm-Liouville operator in the space H — L 2 (R). The 
potential q(t) tends to as t —> —00 and to +00 as t — >• +00. In particular, L is 
essentially self-adjoint on C£°(R) which implies that L is essentially self-adjoint on 
C,5 >0 (M+) in the space L 2 (R + ). Thus, a boundary condition at the point x = is 
unnecessary. Since q(t) — > 00 as t — > 00, a quantum particle can evade to —00 only. 
This ensures that the spectrum of the operator L is simple. 

4.2. The expansion over eigenfunctions of the operator L can be performed 
by the following standard procedure (see, e.g., [13], §5.4). As we will see later, 
in addition to the simple absolutely continuous spectrum which coincides with 
[l/4,oo), for (3 < —1/2 the operator L has a finite number of simple eigenvalues 
Hi, . . . , /1 7v, N — N(f3), lying below the point 1/4. We denote by W-^ the subspace 



■^Note that the integral in 113.41 1 diverges for p(x) = x 2 and hence the definition of the operator 
F should be changed. 
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spanned by the corresponding eigenfunctions. Let u k {t), k > 0, be a real- valued 
solution of equation p.8|) belonging to L 2 (R + ). It has asymptotics p.9[) as t — > — oo 
with a function m(k) which will be calculated later. Then the operator U : % —> 
L 2 (R + ) defined by the equation (cf. ([530]) ) 

/OO 
u k {t)f{t)dt, (4.8) 
-OO 

is bounded, U\^ {p) — 0, the mapping U : HGH (p) -> L 2 (R+) is unitary and 
equation 

(ULf){k) = (k 2 + l/4)(Uf)(k) 

holds. 

The functions u k (x) = x~ 1 / 2 u k (\a.x), fc > 0, satisfy the equation 

- {x 2 u' k (x))' + A- 1 x 2 u k {x) + (3xu k (x) = (fc 2 + l/A)u k {x) (4.9) 

and can be expressed in terms of Whittaker functions: 

u k {x) =x- 1 W-p, ik {x). (4.10) 

It follows from (|4.3p that the function u k (t) = e t / 2 u k {e t ) has as t — > — oo asymp- 
totics p.9p with the function m(k) defined by (I4.4[) . Calculating |m(fc)| and making 
in (|4.4p the change of variables t — \nx, we find that the operator U = FUF^ 1 is 
given by the equation 

poo 

(Uf)(k) = 7T" Vfcsinh2vrfc|r(l/2 - ik + (3)\ / a;- 1 W_ wfc (a;)/(a;)da;. 

Jo 

It is bounded, U\ n(p} = 0, the mapping U : HQ n (p) -> i 2 (M+) is unitary and 
equation ()3. 12|) holds. Here is the subspace spanned by the eigenfunctions 
■01, ... , of the operator L. 

Let us calculate these functions. The function u p (x) — x W—p lP {x) for p > 
satisfies equation (14.9[) where the role of fc 2 is played by — p 2 . In view of (I4.2[) it 
belongs to L 2 at infinity. However, it follows from asymptotics (|4.5I) that it does 
not belong to L 2 in a neighborhood of the point x — unless — l/2+p + /3 = — n 
where n = 1,2,.... Moreover, in view of (|4.6I) for all /3 = —1/2 the function 
uo <=£ L 2 . Thus, if /3 > —1/2, the operator L is purely absolutely continuous. If 
P < —1/2, it also has the eigenvalues fi n = 1/4 — (|/3| + 1/2 — n) 2 where n = 1, 2, . . . 
and n < |/3| + 1/2 (then p > 0). According to formula (|4.6I) the corresponding 
eigenfunctions equal 

VUz) = e-'/V-VSL* ^i), p = |/3| + 1/2 - n. (4.11) 

4.3. Now we return to the Hankel operator A with kernel (|1.4j) . It follows from 
(|4.2p that a(x) exponentially decays as x — > oo, and it follows from the first formula 
(|4.5p for p — 1/2 that a(x) ~ x _1 as a; —> 0. Observe that in view of asymptotics 
(|L2)l and (lL3t . function (|4T0)) satisfies both boundary conditions (|2~T|) and ((2~2l) . 
Hence it follows from Theorem 12.11 that 

/•OO 

/ o(a: + v)y- 1 W-0 !ik {v)dy = \{k)x^W-^ lk {x) + X{k)x^M-^ lk (x) (4.12) 
Jo 

where the Whittaker function M_f]^ k is the solution of equation (|2.6p exponentially 
growing as x — > oo. Therefore considering the limit a; — > oo in (|4.12p . we see that 
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necessarily A(fc) = 0. Then we take the limit x — > and use asymptotics (|4.3[) 
Since a(x) ~ x" 1 as x — > 0, we have 



a{x + y)y- 1 W^f j , tk {y)dy =2 Re (m(k) I (x + yT l y- 1,2+lk dy) + 0(x 1/2 ) 

=2\{k) Re (m(fc)x- 1/2+4fc ) + 0(x 1/2 ) 



where A(fc) is again given by formula (|3.14p . This yields equation (|1.8[) . 

It remains to calculate eigenvalues Ai, . . . , Ajy of the operator A. The correspond- 
ing eigenfunctions are given by formula (|4.11l) . We proceed again from equation 
(|4.12p where the role of ik is played by p = \(3\ + 1/2 — n. As before considering the 
limit x — > oo, we see that X n — and hence 



a(x + y)e~y/ 2 yP- 1 / 2 L 2 n p _ 1 (y)dy = Ke^^x^ 1 ' 2 L^x). (4.13) 
It follows from (|1.4|) and (|4.2|) that the left-hand side here equals 

/•OO 

r(l + /3)a;-^- 1 e- x / 2 / e- y y p - 1/2 Ll P _ 1 (y)dy (l + O^ 1 )) , x -> oo. 
Jo 

Putting together formulas (2.8.46) and (10.12.33) of [3], we see that 

/•oo 

(n-1)!/ e-V~ 1/2 ^ P -i(y)d?/ = r(p + n-l/2). (4.14) 



Recall also that L 2 ^_ l (x) is a polynomial of degree n — 1 with the coefficient 
(-l)"~7( rl _ at x n-\_ Hence it f ii ows from relation ([4713]) that 

A„ = (-l)"7r/sin7r/3, n = l,2,..., n < + 1/2. (4.15) 

Since eigenfunctions of the operator L are orthogonal and complete, we have 
recovered the result of M. Rosenblum [5]. 

Proposition 4.1. The Hankel operator A with kernel (|1.4[) has the simple abso- 
lutely continuous spectrum coinciding with the interval [0,tt]. Its normalized eigen- 
function corresponding to a point A = 7r(cosh7rfc) _1 from the continuous spectrum 
is given by the formula 



ip k (x) = 7r" 1 v / fcsinh27rfc|r(l/2 - ik + fl)\ x^W-p^x), k > 0. 

Moreover, if j3 < —1/2, then the operator A has eigenvalues (|4.15j) with the corre- 
sponding eigenfunctions defined by (|4.1ip . 

4.4. Next, we turn to the Hankel operator with singular kernel (|1.7[) which 
probably was not considered in the literature. Recall that the MacDonald function 
is defined by the relation K p {z) = 2~ 1 ie 7rip / 2 Hp(iz) where is the Hankel 

function. Now the function b(x) = xa(x) satisfies the Schrodinger equation (|2.3[) 
for the zero energy a — and the coupling constant (3 = 2. Of course, we could 
have taken arbitrary /3 > 0, but we have to exclude negative /3 since in this case 
the function b(x) grows as x — > oo. 

It follows from the well-known properties of that function (II. 7|) has asymp- 
totics 

a(x) = 4 7 r 1 / 2 a;- 3/4 e^ v/ ^(l + 0{ X - 1/2 )) (4.16) 
as x — > oo and a(x) ~ £ _1 as x — » 0. 
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The corresponding operator 

d i d 
L = — —x l — + 2x 

dx ax 

can be studied quite similarly to operator (|4.7I) . For example, the operator L = 
F~ 1 LF acts by formula (|3.6[) where q(t) = 2e*. A solution of equation (12.71) where 
/i = k 2 + 1/4 belonging to L 2 at infinity can be expressed again in terms of the 
MacDonald function 

u k {x) = x~ 1/2 K 2ik (V%x). 
According to formulas (7.2.12) and (7.2.13) of [3] we have 

u k {x) = m(k)x^/ 2+lk + Mk)x- x l 2 - lk + Oix 1 / 2 ), x -> 0, 

where 

m(fc) = i7r2" 1+lfe (r(l + 2ik) sinh27rfc) _1 . 
Calculating |m(fc)| and using (|4.8|) . we see that formula (jl.3[) now looks as 

(C//)(fc) = 27r-Vfcsinh27rfc / 2- 1/2 #2ifc(VSta)/(ai)cfa;. (4.17) 

Jo 

The operator Z, does not have eigenvalues because the functions x~ 1 / 2 K 2p {\f&x) 
for p > do not belong to L 2 in a neighborhood of the point x = 0. Thus, similarly 
to subs. 4.2, we see that the operator U defined by formula (|4.17l) is unitary in the 
space L 2 (R + ) and the operator L has the simple absolutely continuous spectrum 
[1/4, oo). 

Theorem 12.11 implies that 

pOG 

/ a(x + y)y- 1/2 K 2lk (^)dy = \{k)x~ 1/2 K 2lk {V%i) + \{k)x~ 1/2 H ( 2 %{iV%x~) 
Jo 

(4.18) 

(2) 

(the Hankel function H^ ik (iz) exponentially increases asz-> oo) for some constants 
A(fc) and A(fc). Since the integral in (|4.18l) (exponentially) decays as x — > oo, 
necessarily A(fc) = 0. Comparing the asymptotics of the left- and right-hand sides 
of (14.181) as x —> and using that a(x) ~ x _1 as x — ► 0, we find that the constant 
A(fe) is again given by formula (I3.14[) . Thus, similarly to the previous subsection, 
we obtain 

Proposition 4.2. The Hankel operator A with kernel (|1.7[) has the simple abso- 
lutely continuous spectrum coinciding with the interval [0, 7r]. /is normalized eigen- 
function corresponding to a spectral point A = ^(coshTrfc)" 1 is given by the formula 

ipk(x) = 2T7^ 1 Vksmh2Trkx^ 1/2 K 2 ik(VSx), k > 0. 
As a by-product of our considerations, we obtain the equation 

/•OO 

x 1 ' 2 / (x + y y^ 2 K 1 (^x~T^)y- 1/2 K 2lk (^)dy = ^(coshTrfc)" 1 K 2lk (^). 
Jo 

We have not found this equation in the literature on special functions. Note, how- 
ever, that it can formally be deduced from the Shanker equation (|1.8j) if one uses 
the relation (formula (6.9.19) of [3]) 

lim T((3 + l)W-p, m (x/P) = 2x 1 ' 2 K 2m {2x 1 ' 2 ). 

ft— too 
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4.5. The Carleman operator A trivially fits into the scheme exposed above. Now 
the operator A commutes with operator (|1.6|) for a = (3 = 7 = 0. This operator 
has the absolutely continuous spectrum of multiplicity 2 coinciding with [1/4, 00). 
It has eigenfunctions x~ l ' 2Jrik for all k € K which are also eigenfunctions of the 
operator A. The relation between the spectral parameters A and k is again given 
by formula p. 141) so that the operator A has the absolutely continuous spectrum 
of multiplicity 2 coinciding with [0,7r]. 

5. Regular kernels 

5.1. Let us here consider kernels a{x) which decay rapidly as x — > 00 and have 
finite limits asi->0. We set 7 = 2 and distinguish the cases a > 0, (3 is arbitrary 
and a = 0, (3 > 0. Let a = 1/4 and /3 = 2 in the first and second cases, respectively. 
If a = 1/4, then the solution of equation (|2.6j) is given (see subs. 4.1) by the formula 
b(r) = W-p_i/2(r) where W-p t i/2 is the Whittaker function. If a — and (3 = 2, 
then the solution of (|2.6I) equals b(r) = r 1 / 2 Ki(\ /r 8r) where K-y is the MacDonald 
function (see subs. 4.4). The corresponding functions (12.51) decay exponentially at 
infinity and have finite limits as x — > 0. It follows that the operators A are compact. 

Let the function oj(x) be defined by formula (|3.5j) . 77 = uj^ 1 and 

q(t) = -4" 1 (7 ? 2 (t) + 2 V (t)y 1 + a V 2 (t) + (3 V (t). (5.1) 

Since 77(f) ~ e*/2, the potential q(t) — > +00 as f — > 00. It follows that the operators 
-L and hence L have now discrete spectra. We point out that these operators 
are again defined by formulas (|3.6|) and (|1.6|) on functions satisfying boundary 
conditions (|3.7p and (|3.3p . respectively. 

Theorem 12.11 implies that the operators A and L have common eigenfunctions. 
Apparently, eigenfunctions of the operator L cannot be expressed in terms of 
standard special functions. However, in their terms we can calculate eigenvalues 
Ai,A2,... of the operator A. Indeed, suppose that ip^ G D(L) and Lip^ = tjt/v 
Then the function ip^(t) = (F~ 1 ?/' At )(f) satisfies the equation 

^'(t) + «(t)^(*) = (/i-l/4)^(t) 

where q(t) is function ()5.1|) . For a suitable normalization, asymptotics of ifipit) as 
f — >• 00 is given (see, e.g., book [7]) by the semiclassical formula 

Vv(f) ~ g(f)- 1 / 4 exp ( - J* q(s)V 2 ds) . 

It follows that 4>fj,it) ~ e~*/ 2 exp(— 4~ 1 e* — /3f) in the first case and Vv(f) ~ 
e - */ 4 exp(~2 3 / 2 e*/ 2 ) in the second case. Returning to the eigenfuctions ip^x), 
we find that 

%{x) - x- 1 -^-^ 2 and ^(x) ~x- 3/4 e"^, x -> cx), (5.2) 

in the first and second cases, respectively. 

On the other hand, using asymptotics (|4.2I) and (|4. 16[) for function (|1.7I) . we see 
that 

/■OO 

(^)(x) ~ x- 1 -^-^ 2 / e-yft%(y)dy 
Jo 

and 

/-oo 

Jo 
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as x — > oo in the first and second cases, respectively. Comparing these relations 
with relations (|5.2|) and using the equation Aip^ — A^?/> M , we get expressions for 
eigenvalues of the operators A: 

/•OO />oo 

-V = / e~ y/2 ^{y)dy and A M = V2tt / ^(y)dy (5.3) 
Jo Jo 

in the first and second cases, respectively. 

Thus we have obtained the following results. 

Proposition 5.1. The Hankel operator A with kernel 

o(x) = (x + 2)- 1 W^ l3A/2 (x + 2) 
and the differential operator (|1.6[) for 7 = 2 and a = 1/4 Ziaue common eigen- 
functions. Iftp^ G T^(L), Lipfi = W-V aTl ^ VvO*") ^ e /""si asymptotics (|5.2p as 
,t — > oo, i/ien = w ^ ere <\u * s determined by the first formula (I5.3|) . 

Proposition 5.2. TTie Hankel operator A with kernel 

a(x) = (x + 2)- 1 / 2 K 1 {y / 8(x + 2)) 

and the differential operator (|1.6p /or 7 = 2, a = and (3 = 2 have common 
eigenf unctions. If ip^ £ T>[V), Lip^ = jiip^ and ipfj,(x) has the second asymptotics 
(|5.2[) as x — > 00, t/ien Aip^ = X^ip^ where A^ is determined by the first second 
formula (|5.3[) . 

5.2. Finally, we consider kernel (| 1 .4[) for exceptional values j3 = —I where 
I = 1, 2, To be more precise, we now set 

a(x) = (-ly-'Q - ly.^x-'W^ix) = e-^Ll^x), 1 = 1,2,..., (5.4) 

(here we have taken formula (|4.6I) into account). The Hankel operator A with this 
kernel has rank I. Here we show how this simple example fits into the scheme 
exposed above. 

The spectral analysis of the corresponding operator (I4.7[) remains the same as in 
subs. 4.2. In addition to the absolutely continuous spectrum [1/4, 00), the operator 
L has eigenvalues ^ n = 1/4 — (I + 1/2 — n) 2 where n = 1, . . . , I. 

However, instead of the absolutely continuous spectrum, the operator A has the 
zero eigenvalue of infinite multiplicity. Indeed, as in subs. 4.3, Theorem 12.11 yields 
equation ()4.12|) where again A(fc) = 0. Observe that a(x) and hence in view of (|4.3|) 
the integral in the left-hand side of (|4.12l) have finite limits as x — > 0. Therefore it 
follows from (|4.3I) that necessarily A(fc) = for all k > 0. Hence the kernel of the 
operator A is spanned by the functions x~ 1 Wi,ik(x), k > 0. 

Eigenfunctions ip n (%) corresponding to non-zero eigenvalues A„ of the operator 
A are defined by formula (|4.11j) where p = I + 1/2 — n, n < I + 1/2, and A„ can be 
found from equation (I4.13[) : 

/ LU(x + y)e-yyP- 1 / 2 L 2 l p _ 1 (y)dy = X n x p ~ 1 ^ 2 L 2p _ 1 (x). (5.5) 
Jo 

Recall that L^(x) is a polynomial of degree p with the coefficient (— l) p /pi at x p . 
Comparing coefficients at the highest power x l ~ l in the left- and right-hand sides 
of (|5.5I) and taking into account formula (I4.14[) , we find that 

A„ = {-l) n - 1 ^^^ e-yf-^ 2 L 2 l l {y)dy= 
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Thus, we have obtained the following result. 

Proposition 5.3. The Hankel operator A with kernel (|5.4|) has rank I. Its non- 
zero eigenvalues are given by the formula A„ = (— 1)™ where n = and 
the corresponding eigenf unctions ip n (x) are defined by equality f|4. 1 1[) where p — 
l+l/2-n. 
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